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Abstract 

We consider a synthesis problem for a remotely controlled linear system where the communi- 
cation is constrained because of the shared and unreliable nature of the channel. Modeling the 
constraints by a periodic transmission scheme and random message losses, we present an H°° 
design framework and study the limitations in the communication required for stabilization. 

1 Introduction 

We consider a remote control system in which the plant has multiple sensors and actuators con- 
nected to a controller over network channels. In particular, we follow the approach of [12] and 
model two constraints due to the shared and unreliable nature of the channels. One is a periodic 
transmission scheme under which the sensor/actuator nodes take turns to transmit messages in 
a periodic manner. The other constraint is that each transmission is subject to random loss or 
delay due to congestion or error in the communication. Here, it is assumed that if a message is 
delayed, then it is considered lost. The losses are modeled as Bernoulli processes where the loss 
probabilities are a priori known. Further, the controller uses the information regarding the losses 
of the messages that it receives as well as those that it sends; the latter is realized by the use of 
acknowledgement messages with a one-step delay. 

Under this setup, in [12], a synthesis method for stochastic stabilization of linear time-invariant 
plants and for optimization under an i7°°-type norm criterion has been proposed. It is based on 
a necessary and sufficient condition expressed in the form of linear matrix inequalities. Hence, 
we can employ efficient algorithms to investigate the effects of the communication constraints on 
control performance. Another advantage of this approach is that because of the norm criterion 
used in the paper, the design can be viewed as a natural extension of deterministic robust control 
methods. We also note that the synthesis method has been found useful in developing subband 
coding techniques for networked control [15]. 
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The focus in this paper is on the limitations in stabilization due to the message losses and 
in particular on upper bounds for the loss probabilities above which stabilization cannot be ac- 
complished. It turns out that such bounds can analytically be obtained. We emphasize that the 
bounds are expressed in terms of the unstable poles of the plant together with parameters in the 
communication scheme. 

There are two characteristics of the approach in this paper. One is that, by following [20], we 
view the remote control system as a special case of Markovian jump systems (see, e.g., [2, 16]). This 
is a natural approach especially when acknowledgements are available on the controller side. The 
other is that we employ the periodic transmission scheme which has been considered in [9,14,18]. 
In this paper, we show critical bounds on losses which are generalizations of the results for the 
simpler case of SISO plant with single-rate communication. 

Similar bounds on critical loss probabilities have appeared in the recent literature. In the con- 
text of remote control, early studies on such probabilities include [8,21]. In [3], a synthesis problem 
for stochastic stabilization has been considered, and a necessary and sufficient bound for the state 
feedback case is found. The result is extended in [4] to various remote control configurations. 
One difference from the approach in this paper is that the controllers are limited to deterministic 
time-invariant systems. In [10], it is shown in an LQ type problem that the availability of acknowl- 
edgement messages has a crucial impact on controller designs and also on the loss probabilities. 
This issue is further studied in [7,22], where LQG problems over lossy channels are investigated. 
Also, an estimation scheme with filters on the sensor side has been proposed in [23]. For the case 
of nonlinear systems, the treatment of random losses in the channel is studied in [19]. 

This paper is organized as follows: In Section [21 we introduce a class of stochastic systems and 
some definitions. In Section [3l we review the remote control problem considered in [12]. Then, the 
stabilization problem of this paper and the main results are presented in Section 01 To illustrate 
the results, we provide a numerical example in Section [5l Finally, concluding remarks are given in 
Section El We note that this paper is an extended version of [11]. 

2 Periodic systems with random switchings 

In this section, we introduce a class of systems called periodic systems with random switchings and 
provide some definitions and a preliminary result [12]. 

Consider the following periodic system Go with random switchings: 

z k = Ckfi{k) x k + D k Q^Wk, 

where Xk G K n is the state, Wk G M m is the input, Zk G M p is the output, and 9k G Im is the 
mode of the system with the index set Im := {0, 1, . . . , M — 1}. The mode 0^ is assumed to be an 
independent and identically distributed (i.i.d.) stochastic process determined by the probabilities 
a.i = Prob{#fc = i}, i E Im- The system matrices are TV-periodic, that is, e.g., Af :+ j^ ji = A^i for 
each i G Im and k G Z + . 
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Let T k be the sigma-field generated by 9[o :k ]- We assume that the input w k is .Ffc_i-measurable 
for each k. Moreover, w is assumed to be in I 2 in the sense that ^EfcLol^l 2 ] < oo, where 
the expectation E[-] is taken over the statistics of 6. Let the norm of such signals be \\w\\ := 
-^Efc^ol^fcl 2 ] 1 ^ 2 • We denote by W the space of such signals. 

For the system Go in (TjQ), we employ the following notion of stability. The system ([TJ with 
w k = is said to be stochastically stable if for any initial condition xq, 

oo 
fc=0 

We next introduce the / 2 -induced norm of the system Go- Suppose that Go is stochastically 
stable and the initial state is xq = 0. Then, we define the Z 2 -induced norm of the system as follows: 

||Go|| := sup J - !"- 
wew,w^o \\w\\ 

In [12], characterizations of the stability and the norm of the system Go have been obtained. 
They are stated in terms of linear matrix inequalities (LMIs). We present the stability result in 
the following. 

Lemma 2.1 The system Go in (JXJ) is stochastically stable if and only if there exists an iV-periodic 
matrix P k G M nxn such that P k = > and 

CH^l,iPk+xA k ,i ~Pk<0 for k G In , (2) 

where Tat := {0, ... ,N - 1}. 

3 Remote control system and its stabilization 

In this section, we first present the remote control system setup that has been studied in [12]. There, 
an optimal controller design method under an H°° norm criterion is proposed. In this paper, we 
consider the analytic bounds on the loss probabilities to achieve stabilization of this system. 

Consider the remote control system depicted in Fig.[TJ The generalized plant G is a discrete-time 
system and has a state-space equation of the following form: 

x k+l = Ax k + Biw k + B 2 u k , 

z k = Cix k + D u w k + D 12 u k , (3) 
Vk = C 2 x k + D 2 iw k , 

where x k G R n is the state, w k G R mi is the exogenous input, u k G W 12 is the control input, 
z k G W 1 is the controlled output, and y k G W 2 is the measurement output. We assume that 
(A,B 2 ) is controllable and (A,C 2 ) is observable. 

Using a shared communication channel, a remote controller is connected to multiple sensors and 
actuators. Due to the bandwidth limitation in the channel, we assume that at each discrete-time 
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Figure 1: Remote control over a shared channel 



instant, only one of the sensors or actuators can transmit a message over the channel. For efficient 
communication under this constraint, the transmission of the messages is periodic and is a priori 
fixed. We now describe this scheme. 

Let the period be ./V > p2 + m,2- We index the sensors from 1 to P2 and fix the order of 
transmissions within the period N as follows: Let the index set be I P2 +i '■= {0, 1, . . . ,P2}- Then, 
introduce the vector s\ G called the switching pattern for the sensor side. This specifies that 

at time k = IN + r with r = 0, 1, . . . , N — 1, the sensor indexed as s\{r + 1) is allowed to send 
a message; if s\{r + 1) is zero, no communication takes place. For example, let N = 5, p2 = 2, 
and s\ = [1, 1, 2, 0, 0]. In this case, sensor 1 transmits at k = 0, 1, 5, 6, . . . while sensor 2 transmits 
at k = 2,7,..., and there is no communication at k = 3,4,8,9,.... Similarly, we introduce the 
switching pattern S2 G ^m 2 +i f° r the ni2 actuators; this one determines the periodic transmission 
from the controller to the actuators. 

We give some notation for the periodic switchings. First, let e Pi j G MP, i = 1, . . . ,p, be the 
unit vectors given by e Pi j := [0---0 1 0---0], where the ith element equals 1 and the rest are 
zero. Now, the switch boxes S\ and S2 in Fig. [T] are iV-periodic matrices defined for k = IN + r, 
r = 0, 1, . . . ,N - 1, as 

51, k ■= ej 2j j, ifs 1 (r + l)=i, 

52, k '■= e m 2 ,j, if s 2 (r + 1) = j. 

The channel is further constrained by being unreliable due to congestion or delay, and hence 
transmitted messages randomly are lost. Denote by 9i t k,02,k G {0, 1} the stochastic processes for 
the message losses, respectively, from the sensors to the controller and from the controller to the 
actuators. If 8ik = 0, then the message at time k is lost, and otherwise, it arrives. They are 
assumed to be i.i.d. Bernoulli processes determined by 

ai := Prob{6>i jfe = 0} and a 2 := Prob{6» 2 ,fc = 0} 

for k G Z + . Letting be the sigma-field generated by #i,[o,fc]> i = 1)2, we assume that the 
disturbance is Fi^-i- an d ^.fc-i-measurable. Further, the disturbance is assumed to be in the 
space W as defined in Section [2j 

The overall plant G including the switches S± and S2 and the message loss processes 9\ and 62 
is periodically time varying with period N and with random switchings. The state-space equation 
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of G can be expressed as 

x k+ i = Ax k + BxWk + 2 ,kB 2 S 2 ,kUk, 

z k = Cix k + D n w k + 2 ,kDi 2 S 2 ,kUk, (4) 
Vk = Oi,kSi,k(C 2 x k + D 21 w k ). 

In Fig. HI K is the controller to be designed. We allow it to also be iV-periodic. Further, we 
assume that the control Uk is J-\ k - and .T^-i-measurable. That is, at time k, 9i k and Q 2 .k-\ 
are known to the controller. This is realized by the use of acknowledgements from the actuators 
regarding the arrival of the control input u k with a one-step delay. 

The controller takes a state-space form as follows: 

6; = ^fc-i,0i(fc-i),0 2 (fc-i)6c-i + B k -ifi 2 {k-i)iik-i, . . 

Uk = Cfe,6»i(ifc)Cfc + DkVk, 

where £ M n is the state whose dimension is the same as that of the plant. The system matrices 
are A^-periodic in k: For example, Ak+Nij = ^-k,i,j f° r k G Z + and i,j £ {0,1}. Notice that 
the state equation is expressed for the recursion at time k. At this point, #2,fc-i is available at 
the controller through an acknowledgement. Thus, while the A- and l?-matrices make use of this 
information, the C- and D-matrices can not. On the other hand, the B- and D-matrices do not 
use 0i t k because 0i t k = means no input, y k = 0. 

Let the overall closed-loop system in Fig. Q] be F[(G,K). This system is A^-periodic and has 
random switchings with 4 modes: (#i,fc, 2> k) = (0, 0), (0, 1), (1, 0), (1, 1). It thus falls in the class of 
systems considered in Section (2) 

In [12], we have provided an optimal synthesis method under an H°° criterion. More specifically, 
the method solves the following problem: For the system in Fig.[Tl given a scalar 7 > and switching 
patterns s\ and s 2 , design a controller K of the form ([5]) such that the closed-loop system Fi(G, K) 
is stochastically stable and satisfies H-F^G, K)\\ < 7. A necessary and sufficient condition for this 
problem has been derived in the form of LMIs. Thus, using this method, we can numerically check 
whether loss probabilities a\ and a 2 are small enough to accomplish stabilization. 

4 Limitations in loss probabilities for stabilization 

In this section, we present several upper bounds for the loss probabilities in the channel which must 
be met to achieve stabilization. Hence, the bounds represent the maximum allowable probabilities. 
We show that for some specific setups, the bounds become necessary and sufficient. 

For the problem of stabilization, we assume no disturbance, i.e., Wk = 0, throughout this section. 
Hence, we consider the system setup in Fig. [2j We denote by G 22 the (2, 2)-block of the generalized 
plant G. To simplify the notation, replace the triple (A, B 2 ,C 2 ) with (A,B,C). Therefore, the 
realization of G 22 is given by 

Xk+i = Ax k + Bu k , 
Uk = Cx k , 
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Figure 2: Stabilization with periodic transmission 



where Xk € W 1 , Uk £ K 1 " 2 , and yk 6 W 2 . We assume that A is an unstable matrix, that is, it has 
at least one eigenvalue whose absolute value is larger than 1. Denote by Aj, i = 0, 1, . . . , n — 1, the 
eigenvalues of A. 

Here, due to the channel on the sensor side, the measurement y that the controller receives is 



Vk 



.kSi.kUki 



where the behavior of the switch box S\ is determined by the switching pattern s\. The control 
signal u transmitted by the controller and the received signal u at the actuator side are related by 



(7) 



Similarly, the periodic switch box S 2 is specified by the switching pattern s 2 . 

In the following, we study three different configurations and derive upper bounds for the loss 
probabilities. 

4.1 State feedback under single rate transmission 

The first is the state feedback case with a single-rate channel on the actuator side. 

In the system in Fig. [2j assume C = I in © and at\ = (that is, 6\ t k = 1). The transmissions 
are assumed to be single rate in that Si.k = I for i = 1,2; we thus take N = 1. Furthermore, we 
assume that the plant is single input (m.2 = 1). Hence, the control input in ([7]) becomes 



Uk = 2 ,kFx k , 



(8) 



where F S R lxn is the state feedback gain matrix. Recall that #2,fc £ {0, 1} is the loss process 
determined by Q2 = Prob{#2,fc = 0} for k G Z + . 

The following proposition provides an upper bound for the loss probability 02- This result has 
been given in [3]. 

Proposition 4.1 For the system G22 in ©, there exists a state feedback gain F in such that 
the closed-loop system is stochastically stable if and only if the loss probability a 2 is sufficiently 
small that 



a 2 < 



n 



|Ai|>l 



A; 



0) 



6 



The proof of this proposition is given in the Appendix. The approach in this paper is based on 
jump systems results using Lemma 12.11 We have clarified the critical loss probabilities in terms of 
the inequality arising in stochastic stability of such systems (see Lemma lA.ll (ii)). 

The result indicates that the unstable poles of the plant have a direct influence on the allowable 
loss rates in the channel for stochastic stability. The bound above has been found in [3], where the 
relation between state feedback stabilization over an unreliable channel and an optimal quantizer 
design problem has been discussed. 

4.2 Remote control with periodic transmission 

In this subsection, we consider the remote control case with the periodic transmission scheme 
introduced in Section [3l 

Consider the system in Fig. [2J Here, the controller K is limited to the observer-based one as 
follows: 

6c = A£k-i + Buk-i + Lk-i,e 2 {k-\) (^i,fc-iS'i,fc-iC^fe_i — j/fc-i) , (10) 

where £ fl£ n > and F k ^ x ^ and ^^(fc-i) are the feedback and observer gains, respectively. These 
gains are iV-periodic as, e.g., i^+jv,? = Fk,i for all k and i. 

We first consider the case when G22 is SISO. Note that in this case, the switch boxes S\ and S2 
take values of either or 1 and hence function as discrete-time periodic samplers. Their periodic 
behaviors are specified by the switching patterns Sj € {0,1}^, i = 1,2. We denote by iVj the 
number of 1 in the pattern Sj for i = 1,2. As a special class of switching patterns, we introduce 
those called periodic vectors which take the following form: 

N/Ni N/Ni 

Si = {nr^~o ■ ■ ■ To^~o] g r n . (11) 

Some simple examples are Sj = [1 • • • 0] when N{ = 1, and Sj = [1 • • • 1] when Ni = N. 
We are now ready to state the result on the loss probabilities for this setup. 

Proposition 4.2 Suppose the switching patterns s\ and S2 G {0, 1}^ are in the periodic vector 
form in (|lip . and have, respectively, N\ and N2 entries of 1. Then, for the system G22 in there 
exists a controller K of the form (I10|) such that the closed-loop system is stochastically stable if 
and only if the loss probabilities a\ and «2 satisfy 

ai < (12) 

° 2 " n w ,.w»'*- (13) 

Proof : Let the estimation error be e k ■= x k — The closed-loop dynamics can be expressed as 

Xk+i = {A + 02 i kBS2,kFk,e 1 (k)) x k — 02,kB S2,kFk,e x {k) e kj (14) 
e k+i = (A + 6i,kLk,e2{k)Si,kC)ek- (15) 
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The error system (|T5j) is decoupled from the state Xk and in particular from the loss process 9 2> k- 
Using this fact and the structure in the switching pattern s\, we can show by Lemma 12.11 that 
to guarantee stochastic stability of this system, it is necessary and sufficient that there exists an 
observer gain that is independent of k and 9 2j k- The resulting system e^+i = (A + 9\^LSi^C)ek 
is periodic with period N\ := N/N±. 

We now look at its dual system z^+i = (A T + 9\^C T S\^L T )zk with Zk £ M n and express it in 
the so-called lifted form as follows: Let z^ = z k ^. Then, the lifted system is 



z k+l 



(a t )^ + 9 1 ^u t ) n ^c t l t 



Zk- 



Thus, by Proposition 14.11 there exists a stabilizing gain L T if and only if 

P^b{9 lMi = 0} < 1 - . , 

ll|Ai|>ll A *l 

where Aj, i = 0, 1, . . . , n — 1, are the eigenvalues of A Nl . However, since the loss process 9\ ^ is 
i.i.d., the inequality above is equivalent to (fl"3j) . 

Similarly, we can show that the autonomous system x^+i = (A + 9 2 ^B S2 j kFk,8i(k)) x k of (JH]) 
can be stabilized if and only if (I12D holds. This implies that a necessary and sufficient condition to 
stabilize the closed-loop system via output feedback is that the inequalities (|12p and (|13|) hold. □ 

This proposition is a generalization of Proposition 14.11 in two directions. First, it extends the 
result for the periodic transmission scheme. In particular, it shows that the loss probabilities are 
constrained by both the unstable dynamics of the plant as well as the parameters N, N\, and N 2 
in the communication scheme. The implication is the tradeoff between control performance and 
transmission rate. This tradeoff will also be clarified through a numerical example in Section [5j 

Second, the proposition is for the remote control setup with two communication channels. 
An interesting aspect of the result is that the probabilities a\ and a 2 for the two channels can be 
chosen independently and further have the same type of maximum for stabilization. It can be shown 
that these characteristics are consequences of the use of acknowledgement messages; without such 
messages, the controller design is no longer convex and the analysis becomes much more involved 
(see, e.g., [13]). 

For the single-rate case, similar problems have been considered in the literature. In [4], the 
controller is assumed to be time invariant, and the approach involves the simultaneous design of a 
controller and a decoder on the actuator side; the issue of decoder design is considered in the next 
subsection. Another work is [22], where an LQG problem is studied for remote control. 

We next consider the case where the plant G22 is an MIMO system. The following result is 
based on Proposition 14.21 and a result in [12]. 

Proposition 4.3 Suppose the switching patterns si G arid s 2 G ^m 2 +i have, respectively, 

iVi and N 2 nonzero entries. Then, for the system G 22 in ©, there exists a controller K of the form 
()10p such that the closed-loop system is stochastically stable only if the loss probabilities a\ and 
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«2 satisfy 



max 



a 2 < 



max 



x 1 \>i\M 2N/N ^ 
1 



(16) 
(17) 



The bound on a\ above is also sufficient if C is invertible, and the bound on a 2 is sufficient if B is 
invertible. 

Proof: As in the proof of Proposition 14.21 the output feedback problem can be separated to the 
state feedback and state estimation problems. Hence, we prove only for the state feedback problem. 
For this case, we assume s\ = [1 • • • 1] and 6i k = 1. It then follows that the control input is 



(18) 



Further, without loss of generality, we assume that s 2 has the form s 2 = [1 ■ • ■ 10 • • • 0], where 
the first N2 entries are 1 and the rest are 0. 

We express the system using the lifting technique. Let Xk ■= XkN, and let u denote the lifted 
signal of u: 

UkN 
u kN+l 



Uk 



, k <E 



UkN+N-l_ 

Then, the lifted state equation of the plant can be written as 



where A := A N and B := [A N ~ l B A N ~ 2 B 
by (fl8|) . we can write n& as 



x k+ i = Ax k + Bu k , 

B \ . Observe that, by the assumption on s 2 and 



Uk — i 7 6»2(fcA r ),---,f 2 (feA r +A r 2-l)^fc' 



(19) 



where 



"9 2 (kN),- ,6 2 {kN+N 2 -l) 



J2,kN-T0,l 



82,kN+N 2 -lFN 2 -l,l{A + &2,kN+N 2 -2B Fn 2 -2,1) 

■ ■ ■ (A + e 2!kN BF 0)1 ) 








Here, we used the facts that F/-^ is ^-periodic in k and 9%^ = 1. Notice that in the lifted form, 
the closed-loop system is no longer periodic. In this form, on the other hand, the loss process is 
(@2,kN, • • • ,@2,kN+N 2 -i), for which there are 2 Ni modes for each k. 
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It is clear that the stochastic stability of the original system implies that of the lifted system. 
Furthermore, it follows that there exists a gain Fx i such that stability is achieved by the following 
control: 

- Jo tfe 2 ,kN+i = o, vi€{o,...,Jv 2 -i}, 

I F\^.. t \Xk otherwise 

for k G Z+. Under this control, the system has only 2 modes, and the loss probability is 

Prob {9 2:kN+l = 0, Vi € {0, . . . , N 2 - 1}} = 

for k G Z+. Hence, applying Lemma 12. II to this system (with N = 1 in the lemma), we have that 
there exist a positive-definite matrix P G R nx ™ and a gain F± ... i G R m2Xn such that 

a% 2 A T PA + (1 - c^ 2 )(i + BF h ... A ) T P{A + £F W ) - P < 0. 

Thus, it follows that 

af < 

max |Xj|>1 |AiP 

where Aj, i = 0, . . . , n — 1, are the eigenvalues of A. Therefore, we arrive at (|17p . 

To show sufficiency for the case when B is invertible, we can take the feedback gain as F%i = 
—B^^^A. Then, the closed-loop system with the lifted state x k = x^n is described as 

Xk+i = (1 — 02,fcjv) ■ ■ ■ 0- — 02,kN+N2-l)A %k 

It easily follows from Lemma 12.11 that this system is stochastically stable if and only if there exists 
a matrix P > satisfying a N2 {A N ) T PA N - P < 0. This is a Lyapunov inequality, and hence this 
condition is equivalent to (|17p . □ 

We emphasize that in this proposition, the switching patterns are not limited to those in the 
periodic vector form as in Proposition 14.21 The bounds however are stated in a very similar form. 
On the other hand, in general, the result is a necessary condition and thus may be conservative. 
It is also remarked that this proposition is a generalization of the single-rate version (that is, with 
N = 1) that has appeared in [10,12,17,21,22]; see also [23]. 

4.3 Remote control with a decoder 

So far, we have assumed that on the actuator side, when a message is lost, only zero control is 
applied. It indeed appears that there might be some room to improve. In this subsection, we 
employ a decoder which is a system located at the actuator side to compensate the losses as well 
as the periodic transmission. It however turns out that for the purpose of stabilization, the use of 
such a decoder does not provide advantage. 

Consider the system configuration in Fig. El Again, assume that the plant G 22 is an SISO 
system. Further, we take the switching patterns of both channels in the periodic vector form as in 
(jlip . Recall that in Proposition 14.21 the bounds on the loss probabilities are tight for such cases. 
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Figure 3: Decoder on the actuator side 



At the actuator side, a decoder D is used. This is a dynamic, iV-periodic system that depends 
on the losses 9 2j k and outputs the control input Ufc. Specifically, it has a state-space form as follows: 



(20) 



Vk+l = ^D,kVk + B Dk u k , 

Ck = Cn,kVk, 

u k = &2,kS2,k^k + (1 — 6 l 2,fc'S'2 1 fc)Cfc) 

where r\ k G M n ° is the state and £fc G M is the control candidate produced in the decoder. The 
system matrices are iV-periodic. We assume that this system is internally stable in the sense that 
if #2,fc = 0, then rjk — > as k — > oo. This guarantees stability in the local feedback of the decoder. 

Notice that the control candidate C, k is used when a message is lost or when there is no trans- 
mission. A simple example of a decoder is the one-step delay case, where the decoder functions as 
a zero-order hold: If a message is not received, then the previous control value is used. 

The following result provides a necessary condition for the case with a decoder. 

Proposition 4.4 Suppose that for given switching patterns s\ and s 2 in periodic vector forms in 
(fTT]) , the closed- loop system in Fig. [3] with the controller K in (fTU|) and the decoder D in (f2"U|) is 
stochastically stable. Then, the loss probabilities a\ and «2 satisfy the inequalities in ^2]) ~ (fT3|) . 

Proof : As in the proof of Proposition 14.21 the proof can be separated to the state feedback part 
and the estimation part. The estimation part is the same as in the proposition, and thus the upper 
bound (fl2]) on a\ follows. We hence show the state feedback part assuming Oi k = 1. 

Letting x k ■= [x^ f?5T] T , we can describe the dynamics of the closed- loop system under the state 
feedback u k = Fk,8i(k) x k as follows: 



x k+l — {Ak + 82,kBkS2,kFk) Xk, 



where 



A, 



A BCo,k 

A D k + B D k Cr> u 



B 

Bo,k 



F, 



Let A^ 2 := N/N 2 . Then, noting that S 2 ,k = if k ± IN 2 , I G 
lifted state variable x k :- 



■ '■— [Fk,i — Cn,k] ■ 

we can lift this system with the 



X kN 2 aS 



Xk+l 



A + 2M2 BF)x k , 
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where A := Aft ■ ■ ■ Aq, B := Aft ■ ■ • AiBq, and F := Fq. Hence, applying Proposition 14.11 to the 
lifted plant (A, B), we have that the closed-loop system is stochastically stable only if 

a 2 < , (21) 

where Aj, i = 0, 1, . . . , n + n# , are the eigenvalues of A. However, the matrix A is upper block 
diagonal where the diagonal blocks are A 2 and (A D ft 2 _ 1 +B D ft 2 _ 1 C D ft i) ■ ■ ■ (Ad,o+Bd,oCd,o)- 
By the assumption on the decoder, the latter matrix is stable. Thus, (|2ip is equivalent to (|13p . □ 

We have several remarks regarding this proposition. The decoder is an iV-periodic system and 
can be viewed as a generalized hold device. It interpolates the control input when messages are 
lost or when no transmission is made. Clearly, this result and Proposition 14.21 imply that, from the 
perspective of stabilization, such decoders are not of help. In fact, it is sufficient to use zero control 
when no message is received by the actuator. 

It is however still not clear whether the use of a decoder can improve the performance of the 
overall system. In the numerical example in the next section, we make comparisons using an H°° 
design method. It is also noted that, in general, the design of the decoder D together with the 
controller K is a difficult problem. 



5 Numerical example 

We present a numerical example to illustrate the results of the paper. We consider the system 
setup in Fig. Q] and apply the design method introduced in Section El 

As the generalized plant G in Fig. [H we employ the second-order system as follows: 





' 2 
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x k + 


T 


w k + 


T 




Xk+l = 


0.7 


1.1 


l 


2 


Uk 



z k = [0.5 -l] x k + u k , 
y k = [l -2] x k + w k . 

The system is clearly unstable with eigenvalues A« = 1.1,2, i = 1,2. We note that the subsystem 
G 22 is SISO. 

In the first part of this example, we assumed perfect transmission on the actuator side and 
looked at the effect of the switching pattern s\ with N = 3. Three cases were considered: s± = 
[1 0], [1 1 0], [1 1 1]. According to Proposition 14.21 the maximum loss probabilities for a\ can be 
derived for the following two cases: For si = [1 0], the bound is l/(Ai • A 2 ) 6 = 0.00882, and for 
s\ = [1 1 1], it is l/(Ai • A2) 2 = 0.207. The pattern si = [1 1 0] is not in the periodic vector form 
(fTT|) . and hence the proposition is not applicable. We however calculated the probability value 
similarly to the one given in the proposition: l/(Ai • A 2 ) 3 = 0.0939. 

A plot showing the minimum H°° norm versus a.\ is given in Fig. SJ It is interesting to note 
that, for all three cases including s\ = [1 1 0], the closed-loop norms explode exactly at the bounds. 
This plot exhibits a clear tradeoff between the achievable control performance and the transmission 
rate: More transmissions at lower loss rate imply better control. 
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Figure 4: The minimum norm versus ol\ for s\ = [1 0] (dash-dot), s\ = [1 1 0] (dashed), and 
st = [1 1 1] (solid) 

In the second part of simulations, we assumed a channel only on the actuator side with the 
switching pattern S2 = [1 0] and perfect communication on the sensor side. We designed dynamic 
controllers of the form ([5]) for three cases: State feedback, output feedback, and output feedback 
with the zero-order hold type decoder (i.e., it functions as a one-step delay). In these cases, the 
upper bound on ai is l/(Ai • A2) 4 = 0.0427 by the results in Section^ We note that the dimension 
of the controller is different for the one with the decoder since it was designed for the generalized 
plant including the decoder. 

For each 02, the minimum H°° norm for the closed- loop system was calculated. The results are 
plotted in Fig. The norms indeed explode as «2 approach the upper bound. It is interesting to 
note that, for this example, the performance of the system with the decoder is worse especially for 
large 02- This may be explained as follows: As ct2 becomes larger, so does the feedback gain, and 
hence the chance to apply a wrong control is higher. 

6 Conclusion 

In this paper, we have considered the problem of stabilization of a linear system over shared and 
unreliable channels. We have shown that there are critical probability values for the losses above 
which stability cannot be achieved. The implication is the tradeoff between control performance 
and transmission rate for the communication. The approach is based on the H°° design method 
proposed in [12]. 
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A Appendix 

We provide the proof of Proposition 14.11 This proof consists of two steps. The next lemma is the 
key to relate the state feedback problem to another problem arising in H°° control. 

Lemma A.l The following are equivalent: 

(i) The closed-loop system of (J6]) and ^ is stochastically stable. 

(ii) There exists a positive-definite matrix P S M. nxn and a gain F £ R lxn such that 



a 2 A T PA + (1 - a 2 )(A + BF) T P(A + BF) - P < 0. 



(23) 



(iii) There exists a positive-definite matrix P E M. nxn such that 



( 



1 



) 



-i 



A T PA - P - A T PB 



+ B 1 PB 



B 1 PA<0 



1 — a 2 



(24) 



B 1 PB > 0. 

«2 



(iv) There exists a state feedback gain F such that 



F{zl - A - BF)- 1 B\\ < 



1 



y/&2 



where 



is the H°° norm of a transfer function. 
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Furthermore, if the condition (iii) holds for some P, then the inequality f|23|) in (ii) holds with the 
same P and the gain F given by 

F = — (B T PBy 1 B T PA. 

Proof: The equivalence between (i) and (ii) is a direct consequence of Lemma 12.11 We next show 
that (ii) holds if and only if (iii) does. The inequality (|23h in (ii) is equivalent to the following one: 

A T PA - P + (1 - a 2 ) (F + (B T PB)- 1 B T PA) T B T PB (F + (B T PB)- 1 B T PA) 

- (1 - a 2 )A T PB(B T PB)- 1 B T PA < 0. (25) 

This is shown by expanding (|23|) and then completing the square for F. Hence, (ii) is equivalent 
to the existence of P > such that 

A T PA - P - (1 - a 2 )A T PB(B T PB)- 1 B T PA < 0. (26) 

Now, suppose that (ii) holds, that is, the inequality (|26[) above holds. This inequality can be 
expressed as 

A T PA -P- A T PB I — — — B T PB + B T PB] B t PA < 0. 



1 - « 2 

We also note that the inequality (j23H holds for any scaling \xP of P with positive real [x. Thus, 
there exists \x such that \i < (a2B T PB)~ 1 , but sufficiently close to (a 2 B T PB)~ l that satisfies 

A t /jPA -iiP- A T fiPB ( — - — + B T {iPb) B t hPA < 0. 

\i-a2 / 

Therefore, for fj,P, the inequalities (|24p in (iii) hold. 

To show the converse, observe that the second inequality in (|24[1 implies 

;i - q 2 ) (b t pbY 1 > ( + B T PB 



1 - Q 2 

Hence, for P satisfying (|24|) in (iii), the inequality (|26|) also holds. This implies (ii). More- 
over, the last statement of the lemma holds true since, in view of (|25p . P and the gain F = 
— (B T PB)~ 1 B T PA satisfy the inequality ([23]). 

The equivalence between (iii) and (iv) can be shown using the standard H°° control theory; 
see, e.g., [1]. □ 

The H°° control problem in (iii) in the lemma has appeared in the context of quantized control 
with logarithmic quantizers [5,6]. The following result is from [6, Lemma 2.4], which provides an 
analytic bound for the problem. 

Lemma A. 2 

mi\\F(zI - A- BF)- 1 B\\ = JJ |Aj|, 

|Ai|>l 

where the infimum is taken over F such that A + BF is stable. 

The proof of Proposition 14. II now follows immediately from Lemmas I A . 1 1 and I A . 2 1 We note that 
Lemma I A. II provides a method to design the feedback gain F for each a 2 satisfying the bound © . 
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